Improved Automatic Computation of Hessian Matrix Spectral Bounds

نویسندگان

  • Moritz Schulze Darup
  • Martin Mönnigmann
چکیده

This paper presents a fast and powerful method for the computation of eigenvalue bounds for Hessian matrices ∇2φ(x) of nonlinear wice continuously differentiable functions φ : U ⊆ R → R on hyperrectangles B ⊂ U . The method is based on a recently proposed procedure [9] for an efficient computation of spectral bounds using extended codelists. Both that approach and the one presented here substantially differ from established methods in that they deliberately do not use any interval matrices and thus result in a favorable numerical complexity of order O(n)N(φ), where N(φ) denotes the number of operations needed to evaluate φ at a point in its domain. We improve the method presented Mönnigmann (in [9]) by exploiting sparsity, which naturally arises in the underlying codelists. The new method provides bounds that are as good as or better than those from the most accurate existing method in about 82% of the test cases.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Automatic Differentiation Tools in Optimization Software

We discuss the role of automatic differentiation tools in optimization software. We emphasize issues that are important to large-scale optimization and that have proved useful in the installation of nonlinear solvers in the NEOS Server. Our discussion centers on the computation of the gradient and Hessian matrix for partially separable functions and shows that the gradient and Hessian matrix ca...

متن کامل

Efficient computation of spectral bounds for Hessian matrices on hyperrectangles for global optimization

We compare two established and a new method for the calculation of spectral bounds for Hessian matrices on hyperrectangles by applying them to a large collection of 1522 objective and constraint functions extracted from benchmark global optimization problems. Both the tightness of the spectral bounds and the computational effort of the three methods, which apply to C2 functions φ : R → R that c...

متن کامل

Sharp Bounds on the PI Spectral Radius

In this paper some upper and lower bounds for the greatest eigenvalues of the PI and vertex PI matrices of a graph G are obtained. Those graphs for which these bounds are best possible are characterized.

متن کامل

ADMAT: Automatic differentiation in MATLAB using object oriented methods

Differentiation is one of the fundamental problems in numerical mathematics. The solution of many optimization problems and other applications require knowledge of the gradient, the Jacobian matrix, or the Hessian matrix of a given function. Automatic differentiation (AD) is an upcoming powerful technology for computing the derivatives accurately and fast. ADMAT (Automatic Differentiation for M...

متن کامل

Improved computation for Levenberg-Marquardt training

The improved computation presented in this paper is aimed to optimize the neural networks learning process using Levenberg-Marquardt (LM) algorithm. Quasi-Hessian matrix and gradient vector are computed directly, without Jacobian matrix multiplication and storage. The memory limitation problem for LM training is solved. Considering the symmetry of quasi-Hessian matrix, only elements in its uppe...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • SIAM J. Scientific Computing

دوره 38  شماره 

صفحات  -

تاریخ انتشار 2016